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Description 

[0001] The present invention relates generally to the field of computer graphics software and to the rendering of 
computer-synthesized color images, and more particularly to a method for rendering computer-synthesized color im- 
5 ages having image colors which are in the color gamut of a designated output medium, and a machine for implementing 
such a method. 

[0002] Computer graphics software and rendering systems provide for the computer synthesis and reproduction of 
realistic color images and are capable of producing images that include the entire range of visible colors. The broad 
functions of the typical, computer-based image creation process are illustrated in, and described with reference to, 

w FIG 13 of USSN 07/965,685 (hereafter "Ref. 1"), a copy of which was filed with the present application. As a scene 
is constructed by the scene designer, an application-specific model captures data about object primitives, and rela- 
tionships among them, that comprise the scene, in box 20. The scene description, stored in an application database 
22 contains descriptions of primitives that define the shapes of components, objects, and light sources in a scene, 
appearance attributes of the primitives such as color, and surface texture, and connectivity relationships that show 

15 how object primitives are positioned and fit together in the scene. The scene description must then be converted into 
the set of image pixels for display of the image on an output medium, typically on a monitor or in hardcopy form. The 
process of mapping the scene description to an image pixel file is typically referred to as "rendering", and the imple- 
mentation of rendering is referred to as "the renderer", shown in FIG. 13 of Ref. 1 by dotted line box 24. 
[0003] As can be seen from the functional steps illustrated in FIG. 13 of Ref. 1 , any changes that a scene designer 

20 may want to make to the image that affect the object primitive level of the image, such. as the colours of the objects, 
will mean changing the scene description database 22 and re-rendering the image, which is a computationally expen- 
sive procedure. This includes making changes to the colors of objects in an image, since information about objects, 
including their colors, is only available in the scene description 22. Alternatively, changes to the image made beyond 
rendering pipeline 24 must be made at the pixel level. Manually changing object or light source colors at the pixel level, 

25 while still maintaining the image realism, is difficult for the scene designer to accomplish accurately. 

[0004] In another computer-based image creation process, a scene designer is permitted to manipulate scene de- 
scription colors, surface properties, and light intensities without the computational expense of re-rendering the entire 
image. This method is described in detail by Carlos H. Sequin and Eliot K. Smyri in "Parameterized Ray Tracing", 
Proceedings of SIGGRAPH 1989, July 31 - August 4, 1989 Boston Mass., in Computer Graphics 23 (July 1989), pp. 

30 307 - 314, (hereafter, "Sequin"). That method is illustrated in, and discussed in detail with reference to, FIG. 1 of Ref. 
1 . Briefly, the method modifies a conventional ray tracing program of the type which could be used in shaded rendering 
process 30 of FIG. 13 of Ref. 1, to produce a parameterized, or symbolic, expression for each pixel as the scene is 
rendered. Rendering system 25 in FIG. 1 of Ref. 1 utilizes this modified symbolic shaded rendering process to produce 
a symbolic pixel expression for each pixel in the rendered image. 

35 [0005] All of the colors physically producible on a particular color output medium is called the color "gamut" of the 
medium. The color gamut of an existing output medium is typically smaller than the set of all visible colors which are 
possible in a rendered image. Moreover, the scene description is typically created independently of the output medium 
on which it is subsequently displayed or reproduced. The algorithms used in shaded rendering process 30 for modeling 
the light striking a particular point on an object may very well generate a value for the color of one of the object's pixels 

40 that is not within the range of the valid values in the color gamut of the output medium, or that numerically represents 
a non-visible color, such as a negative value. In most instances, a "gamut mapping" process 40 is necessary to make 
sure that the color attribute for each pixel in the image is displayable or reproducible on the device selected for display 
or reproduction. Gamut mapping process 40 is described in more detail below, in conjunction with the discussion 

accompanying FIG. 1 of Ref. 1. 

45 [0006] The technique of producing symbolic pixel expressions illustrated in FIG. 1 of Ref. 1 , while significantly re- 
ducing the time involved in changing colors and light intensities in a scene, may still produce final image pixel colors 
which are outside the gamut of the output medium which will display or reproduce the image, since the image is created 
independently of the output medium on which it is subsequently displayed or reproduced. Thus, as shown in FIG. 1 of 
Ref. 1 , the pixel colors of image pixel file 32 most likely will need to be mapped to the specific color gamut of the output 

so medium, in gamut mapping process 40, before display or reproduction. 

[0007] Gamut mapping process 40 includes gamut mapping step 42 which applies information about the available 
color gamut of the output medium from device gamut data file 44 to automated mapping algorithms in order to bring 
out-of-gamut pixel colors inside the device gamut. Typically, device gamut data file 44 is comprised of data from a 
sample set of actual colors from the color gamut of the output medium which have been physically measured by an 

55 appropriate instrument, such as a colorimeter or spectrophotometer. The output of gamut mapping step 42 is a modified 
set of image pixel colors, shown in data file 46, that are now in-gamut for a particular output medium. Since each device 
gamut is different, a new set of image pixel colors is created by the automated gamut mapping process for each output 
medium on which the image is to be displayed or reproduced. 
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[0008] The goal of gamut mapping is to fit the image colors into the gamut of the output medium while maintaining 
overall appearance of the image. The gamut mapping process has generally been the concern of those involved in 
the reproduction or display of color images, and typically has not been a processing goal of the graphics rendering 
pipeline 24 (FIG. 13 of Ref. 1) or symbolic shaded rendering system 25 (FIG. 1 of Ref. 1), nor a primary concern of 

5 the scene designer. It is a post-rendering step, accomplished typically by using various automated methods imple- 
mented in software which globally or locally modify individual pixel colors without regard to the objects in the image 
from which the pixels are derived. Gamut mapping may also be accomplished manually. Typically, the gamut of the 
output device is mathematically represented as a three-dimensional volume in a color space, and pixel colors are 
presented as points in the color space. One common automated gamut mapping method is a "uniform global scaling" 

10 of all of the pixels in the image such that the pixel colors most outside the gamut volume of the device are brought 
within the gamut region in the color space, and all other pixel colors are scaled in proportion. Uniform global scaling 
is conceptually similar to "turning down the light" in the scene description. In some, or perhaps many, cases, global 
scaling of the image pixel colors darkens and desaturates the resulting image unacceptably. Another common auto- 
mated gamut mapping method involves the "local correction" of pixels, where each pixel is independently examined 

is and brought into the gamut of the specific display device on which the image is to be produced. One undesirable effect 
of most methods of modifying the out-of-gamut pixels alone, apart from the objects in the scene, is the introduction of 
shading artifacts into the image. 

[0009] Another highly undesirable effect of all gamut mapping done at the pixel level is to produce an image which 
is no longer semantically consistent with the interplay of light with objects in the scene. The concept of image semantic 
20 inconsistency and problem with the existing process of modifying individual image pixels of objects having out-of-gamut 
colors is discussed in detail in Ref. 1 with reference to FIG. 2 thereof. 

[0010] For example, in a synthesized image containing several brightly coloured objects and also containing reflec- 
tions (56 and 58) of these objects in a window (55), generated by rendering pipeline 24 (FIG. 13 of Ref. 1 ), the colours 
of the reflected objects are semantically consistent colours of the "real" objects. If the colours of the real objects are 

25 not in the gamut of a particular output device, correcting the colours using uniform global scaling of the image pixel 
colors will darken both of the objects as well as their reflections, and darkening of the reflections may result in consid- 
erable loss of object detail. It is found that local correction of only the out-of-gamut (red) pixels of a certain object (truck 
52) to bring them within the gamut of the device will result in a semantically inconsistent image where the reflections 
of the object reflect a different relationship between the relative brightness of the objects than what is seen between 

30 the objects themselves, once corrected for out-of-gamut colors. Alternatively, after the rendering of the image is com- 
pleted, a user might manually control parameters in automatic mapping algorithms in order to adjust, through trial and 
error and using artistic judgment, the individual out-of-gamut pixel colors for each of the pixels in the image in order 
to bring the pixel colors in-gamut in a manner which achieves or almost achieves semantic consistency. This solution, 
however, rarely provides image semantic consistency because of the complexity of the task, and requires a manual 

35 adjustment step which typically involves considerable trial and error because of the relatively unpredictable nature of 
the changes involved. Thus, semantic inconsistency resulting from a post-rendering gamut mapping process can arise 
in most rendered scenes which model diffuse and specular inter-reflection of light in the scene. 
[0011] One method for achieving both in-gamut pixel colors and semantic consistency of object colors and lights in 
the image for the device on which the image is to be displayed or reproduced, is for the scene designer to try to make 

40 color changes to the objects in the original scene description database in order to bring the out-of-gamut colors of 
certain objects in gamut. If the scene designer is using a symbolic rendering system, such as the one illustrated in Fig. 
1 of Ref 1 , re-rendering the scene would not be necessary, but manual adjustments to the colors in the scene would 
still be required. While this solution of changing the scene description produces semantically consistent images, it 
requires the manual adjustment of the scene description or the symbolic pixel expressions, which can be a time con- 

45 suming process, especially if re-rendering is involved. 

[0012] Because the spectrum, or color description, for one object or light primitive in scene description 22 (Fig. 2) 
may appear in more than one symbolic pixel expression 80, a modification to one color description may correct some 
out-of-gamut pixel colors while producing other pixel colors which were formerly in-gamut but become out-of-gamut 
as a result of the modification. Thus, the problem of directly modifying the original color descriptions to produce an in- 

50 gamut image is typically more complex than simply bringing all of the color descriptions into the gamut of the selected 
output device. In addition, any single set of modifications directly to the original color descriptions could produce an 
image having all in-gamut pixel colors, but that image may not satisfy the image metric. 

[001 3] What is needed, therefore, is a method of rendering a color image with semantically consistent object colors 
that are always within the measured gamut of the specific output medium on which the image is to be reproduced or 
55 displayed, thus avoiding both the manual and automatic correction of image pixel colors which introduce image and 
object semantic inconsistencies during post-rendering pixel color adjustments. 

[0014] EP-A-0475554 is concerned with the problem of calibration. In Figure 6, CMYK data (see box labelled CMYK 
in bottom left corner of Figure 6) is transformed by a look-up-table (see LUT 236) and output on a CRT 616. The object 
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of the system shown in Figure 6 is to construct LUT 236 so that the output on CRT 616 resembles the output 612 of 
printing device 214. 

[001 5] ACM Transactions on Graphics, vol. 7. no 4, Oct. 1 988, pages 249-292; US; Stone et al. Color gamut mapping 
and the printing of digital color images" is concerned with gamut mapping and utilizes a calibration table. 
5 [00161 The present invention provides a method of rendering a color image from symbolic image data, according to 
claim 1 of the appended claims, and a machine for rendering a color image from symbolic image data, according to 

claim 8. , . . .. , 

[0017] The method of the present invention, in particular, is a device directed method of performing the gamut map- 
ping process 40 of Fig. 1 of Ref. 1 earlier in the image synthesis and rending process, at the point where information 

10 about object primitives and their color attributes in a scene description is available, but after the point where the fixed 
scene geometry has been determined by a conventional rendering method. Preferably, the method uses the symbolic 
color image data and the color description data which are the output of a symbolic shaded rendering system. The 
symbolic color image data, in the form of symbolic pixel expressions, directly represent the interplay of l.ght and object 
primitives in the original scene description. The color description data contain the light intensities and colors of the 

)5 object primitives in the scene, which have been separated from the scene geometry itself, but which are associated 
with the symbolic color image data via unique identifiers such as indices. The method of the present invention is prem- 
ised on the discovery that, since the light and color values have been separated from the scene geometry, they are 
available for modification with respect to the color gamut of a particular color reproduction device, and the effect on 
the original scene of every modification made to the the light and color values will be captured in the terms of the 

20 symbolic expressions. Thus, the method also uses device color data which represents the color gamut of the color 
output medium. Using the symbolic color image data, the indexed color description data, and the device gamut data, 
the method performs spectral change calculations to determine modifications to the indexed color description data that 
produce colors which are in the gamut of the color output medium, and which, when used with the symbolic color image 
data in a later step, will generate a target color image where each target color is one of the device colors in the gamut 

25 of the color reproduction device. Because the symbolic pixel expressions 80 maintain picture information in a symbolic 
form at the object primitive level, any changes to the colour and light intensity values which are substrtuted in the terms 
of the expressions result in changes at the object level in the colour image, thus changing not only object colours, but 
also changing the portions of the image that are affected by the changes in object colours. This occurs because the 
method 90 of the present invention simultaneously changes all of the appropriate symbolic color terms wherever they 

so occur in the symbolic pixel expressions 80. All image pixels which have light contributions from an object primitive with 
a changed colour value are thus changed, and the image remains semantical^ consistent while the colours are brought 
in gamut for the designated output medium. 

[001 8] The method of the present invention thereby preserves semantic image consistency in each rendering, without 
the need to re-render the image, by utilizing the symbolic pixel expressions and associated color descnptions to rep- 
35 resent information about object primitive relationships in the rendered color image, and produces image pixel colors 
which make effective use of as much of the available gamut of the display device as is possible, and require no further 
post-rendering gamut mapping prior to display or reproduction of the image. In addition, the automated process of 
producing semantical^ consistent, in-gamut images can simply be performed again to reproduce or display the image 
another time on the same device, without the need to repeat time-consuming manual adjustments to pixel or scene 

40 object colors. . . 

[001 91 The method of the present invention produces a semantical^ consistent rendered color image and maintains 
this image semantic consistency while the final image colors are brought within the gamut of the designated output 
medium without the computationally expensive step of re-rendering the image or the time-consuming post-rendering 
step of manual pixel color adjustment. Because the symbolic pixel expressions 80 maintain picture information in a 

45 symbolic form at the object primitive level, any changes to the color and light intensity values which are substrtuted in 
the terms of the expressions result in changes at the object level in the color image, thus changing not only object 
colors but also changing the portions of the image that are affected by the changes in object colors. This occurs 
because the method 90 of the present invention simultaneously changes all of the appropriate symbolic color terms 
wherever they occur in the symbolic pixel expressions 80. All image pixels which have light contributions from an object 

so primitive with a changed color value are thus changed, and the image remains semantical^ consistent while the colors 
are brought in gamut for the designated output medium. Utilizing the method of device directed rendenng for rendenng 
the image 50 of an outdoor street scene in FIG. 2 for a particular output medium would result in bnnging the red pixels 
of bright red fire truck 52 into the gamut of the output medium, while also maintaining the brightness relationship 
between fire truck 52 and construction cone 54 in the colors of their reflections in the window 55. 

55 [0020] In particular, and more preferably, the spectral calculations comprises the steps of assigning change variables, 
or weights to the symbolic color image data, each change variable having a current value; evaluating the symbolic 
color image data with the indexed colour description data indexed to respective ones of the symbolic colour image 
data to generate a current color image composed of current colors, the current values for the change vanables being 
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applied to the indexed colour description data items indexed by the respective symbolic colur image data items; and 
generating a target color image composed of target colors from the current colors of the current color image using the 
device gamut color data representing a gamut of device colours of a colour reproduction device; each of the plurality 
of target colours composing the target colour image being one of the device colours in the gamut and corresponding 

5 to one of the current colours of the current colour image. Then, calculating difference data between the current colors 
and the target colors is calculated. Using the difference data, incremental change quantities for the values of the change 
variables are determined in order to find the next set of values for the change variables. A test is then made to determine 
from the difference data and from the incremental change quantities whether the current color image satisfies image 
metric data. The image metric data includes relationship data for measuring a valid color image in terms of a relationship 

10 between the current color image and the target color image, and change variable data for measuring a minimum 
acceptable quantity for the incremental change quantities If the current color image does not satisfy the image metric 
data, then the incremental change quantities are applied to update the current values of the change variables, and the 
above steps are repeated again, as long as the image metric is not satisfied. Once the image metric is satisfied, the 
current values of the change variables assigned to the symbolic color image data are applied to the corresponding 

15 indexed color description data to produce the modified color description data. 

[0021] Preferably, the step of determining a new value for at least one change variable includes the steps of (b 1) 
determining an incremental change quantity from a current value of the change variable; and b 2) applying the incre- 
mental change quantity to the current value of the change variable to obtain the new value. 

[0022] Preferably, each symbolic color image data item includes a symbolic pixel function of the change variables 

20 and the symbolic spectral components; and the step of determining an incremental change quantity includes the steps 
of (i) differentiating each symbolic pixel function with respect to the change variables therein to produce differentiated 
symbolic pixel functions; (ii) constructing a jacobian matrix in the memory of the machine from the differentiated symbolic 
pixel functions; (iii) computing and store in the memory of the machine a pseudo-inverse jacobian matrix from the 
jacobian matrix; and (iv) evaluating the pseudo-inverse jacobian matrix using the current value of each change variable 

25 to find the incremental change quantity for each change variable. 

[0023] Preferably, the desired relationship represented by the image metric data is a distance quantity in a color 
space between each of the image pixel color data items composing the color image and a corresponding one of the 
target image pixel color data items; and the color image satisfies the relationship represented by the image metric data 
when the distance quantity is minimized. 

30 [0024] Preferably, the method further includes after step (a) and before step (b), the steps of (a. 1) initializing the 
change variables with initial values having no modification effect on the symbolic spectral components; (a 2) evaluating 
each symbolic spectral component of each symbolic color image data item with the indexed color description data 
items to produce a plurality of ideal image pixel color data items composing an ideal color image; and (a 3) storing the 
ideal image pixel color data items in the memory; and wherein the image metric data represent a desired relationship 

35 between the plurality of ideal image pixel color data items composing the ideal color image and the target image pixel 
color data items composing the target color image. 

[0025] In summary, the method of the present invention modifies individual object and light source scene spectra in 
order to produce a rendered color image having colors that are directly displayable or reproducible on a selected output 
medium without an additional gamut mapping step applied to individual image pixels The image produced by the 
40 method preserves semantic relationships and consistency among the objects in the image while taking advantage of 
the widest range of colors available in the output medium's gamut. By changing the scene description rather than 
individual image pixels, the introduction of shading artifacts is avoided, and changes in the relative brightness of objects 
and in pixel chromaticity, in certain instances, are permitted. 

[0026] Other aspects of the present invention will become apparent as the following description proceeds and upon 
45 reference to the drawings, in which: 

Figure 1 is a block diagram illustrating the data flow for color image rendering using the method of device directed 
rendering according to the present invention; 

Figure 2 is a block diagram illustrating the functional steps for the method of device directed rendering shown as 

so block 90 in FIG. 1; 

Figures 3 and 4 diagrammatically illustrates using weighted vectors according to one embodiment of the present 
invention to represent colors in a color space, and modifying the weights to change the colors; 
Figures 5, 6, 7 and 8 conceptually illustrate a model of an image, or picture, function used according to an em- 
bodiment of the method of the present invention; 

55 Figure 9 is a flow chart illustrating the steps of one implementation of the method of the present invention; 

Figures 10, 11 and 12 are block diagrams of suitable machine configurations which may be operated according 
to the present invention; 

Figure 13 illustrates schematically representative data structures used by the present invention; 
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In the Figures, the same numbers have been used to denote the same elements. 

[0027] In FIG 1 , the device directed method for rendering a color image, illustrated as spectral change calculator 90, 
uses as input the original color and light intensity values for the scene description in indexed color description data 84 
and symbolic color image data, called symbolic pixel expressions 80, both generated by a rendering system, and device 
gamut color data 44, defining the colors capable of reproduction by color device 49. The method performs spectral 
change calculations to produce as its output, a set of modified color descriptions 86 which are modified color and light 
intensity values for the scene description. When the modified color descriptions 86 are used, along with the symbolic 
pixel expressions 80, in the symbolic pixel expression evaluator 82, image pixel color data 46 composing a color image 
is produced which has pixel colors which are substantially all in the device gamut of device 49. The modified color 
description data 86, together with the symbolic pixel expressions 80, now represent the color image rendered for device 
49, and no gamut mapping step prior to display or reproduction is needed to ensure displayable colors on output 
medium 49. It is not necessary to perform evaluation step 82, however, until a user or viewer of the color image is 
ready to display or reproduce the image. 

[0028] FIG. 2 illustrates the broad steps of performing the spectral change calculations. Each of the originally defined 
color and light intensity values for the scene description 22 in indexed color description data 84 is modified, in box 94. 
The details describing one way in which the color descriptions are modified is set forth below, with respect to the 
illustrated embodiment. Generally, the color descriptions must be modified in a manner which, when all of the modified 
color descriptions are evaluated in the symbolic pixel expressions 80 to produce a color image for display, in symbolic 
pixel expression evaluator 82, the color image which is produced by symbolic pixel expression evaluator 82 is composed 
of pixel colors in the device gamut 44 of device 49. Typically, the color descriptions will be modified in a manner which 
results in the modified color being in device gamut 44, although they may be adjusted to meet other similar criteria. 
The modifications need not be directly made to the values of the original colors in indexed color description data 84. 
Since the original colors are indexed to and represented in the symbolic pixel expressions, manipulations of the sym- 
bolic color terms in the symbolic pixel expressions, which result in modifying the values of the color descriptions when 
they are substituted in the symbolic pixel expressions, may also accomplish the necessary modifications indirectly. 
[0029] Once a first set of modifications to the indexed color description data 84 has been made, the modified color 
descriptions are evaluated, in box 82, in the symbolic pixel expressions 80 to produce a color image. 
[0030] In box 1 00, each image pixel color in the color image is mapped to the device gamut of a specific display or 
reproduction device (shown as device 49 in FIG. 1 ) using a conventional gamut mapping process. Typically, the device 
gamut of a device is conceptually and mathematically represented as a three-dimensional volume in color space, and 
a mapping process finds a desirable replacement color in the device gamut for the out-of-gamut color, according to a 
mathematical algorithm for finding a desirable replacement. The device gamut, however, may also be represented in 
other ways, such as, for example, as simply a look-up table of measured color values for valid device colors. Device 
gamut data 44 include the data needed to represent the gamut in the manner selected by the implementation. The act 
of mapping each pixel color in the current color image to the device gamut using device gamut data 44 generates a 
target color image having all pixel colors in the gamut of device 49. 

[0031] The inquiry in box 96 tests whether the target image generated in box 100 satisfies an image metric which 
measures whether the target image is a valid target image. The image metric, in its simplest form, may simply require 
that all evaluated symbolic pixel expressions 80 produce in-gamut pixel colors. However, there may be many modifi- 
cations to the original color descriptions in indexed color description data 84 which would produce one or more color 
images having substantially all pixel colors in the device gamut represented by device gamut data 44. The image metric 
may determine which one or ones of the possible target color images are valid target color images. The image metric 
may also provide for modifications to the color descriptions to stop within a certain number of processing cycles (in 
which case any remaining out-of-gamut pixel colors will remain out-of-gamut). 

[0032] The determination of validity of a target color image may be established in a number of ways, and a specific 
image metric is described in more detail below with respect to the illustrated embodiment. Generally, the goal of the 
device directed rendering method of the present invention is to find a set of color values for the colors of the objects 
and lights in the rendered image which are in the device gamut represented by device gamut data 44, and which 
produce an image which is acceptable, for some measurement of "acceptable". Thus, the validity measurement of the 
image metric is typically a measurement of target color image acceptability to the user of the method. In one embodiment 
of the method, the acceptability measurement of the target color image is stated in terms of, or as a function of, the 
original color image rendered by the rendering system. An original color image, also called an "ideal" color image, may 
be generated by evaluating (using symbolic pixel expression evaluator 82) the symbolic pixel expressions with the 
original indexed color descriptions 84, prior to modification, and each target color image generated may be compared 
in some manner to the ideal color image to determine validity as a measure of whether the target color image is an 
acceptable substitute for the ideal color image. The image metric may also, for example, or provide a measurement 
of the perceptual suitability of an arbitrary image as a substitute for the original, ideal image. 
[0033] If the image metric has been satisfied, the indexed color descriptions as currently modified are the color 
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descriptions to be saved as in-gamut color description data 86 (FIG. 1 ). The modified, in-gamut color descriptions 86 
are the set of color descriptions which produce an in-gamut target picture which satisfies the measurement expressed 
in the image metric, and which, together with the symbolic pixel expressions 80, produce the valid in-gamut target 
picture. 

[0034] If, however, the modified color descriptions do not produce the in-gamut target picture which satisfies the 
image metric, the process flow returns to repeat the modification, evaluation, and mapping steps. It may be possible, 
in a particular implementation of the method steps illustrated in FIG. 2, to simultaneously modify all of the indexed color 
descriptions that require modification to produce the target color image which satisfies the image metric. In that imple- 
mentation, the image metric would be satisfied with the first target color image produced from modified color descrip- 
tions, and the method would terminate without repeating steps 94, 82, and 100. 

[0035] The method of the present invention begins with the output generated by a symbolic rendering system: the 
symbolic pixel expressions 80 and the indexed color descriptions 84. The creation of the scene and the scene descrip- 
tion database are accomplished in the same manner as described in Ref. 1 with reference to FIGS. 12 and 1 thereof, 
utilizing known modeling, painting, or other software tools for creating images. The scene description contains descrip- 
tions of primitives that define the shapes of components, objects, and light sources in an image, appearance attributes 
of the primitives such as transparency, color, and surface texture, and connectivity relationships that show how objects 
are positioned and fit together in the image. In the illustrated embodiment, each color of an object surface or illuminant 
in the scene description that is the input to the symbolic rendering system is represented as a single spectral function 
of wavelength. For an illuminant, the spectrum represents the amount of power at each wavelength; for a surface, the 
spectrum represents the amount of incident light reflected at each wavelength. However, the method of the present 
invention is intended to also cover other illumination and reflection models. 

[0036] In the illustrated embodiment, the scene description is provided to a symbolic rendering system which uses 
a modified ray tracer to produce an image, or picture, in symbolic form having one symbolic pixel expression 80 for 
each image pixel. The ray tracing method assumed one ray per pixel. The method of the present invention, however, 
is suitable for use with other rendering models, shading equations, and screen sampling patterns. 
[0037] An indexed is assigned to each unique color in the scene, from both illuminants and surface reflections. The 
indices along with their associated color descriptions (spectra) are output, either as a separate file of indexed color 
descriptions 84 as shown, or as part of the file of symbolic pixel expressions 80. FIG. 13 illustrates a representative 
structure for the file 84 of data items comprising the indexed color descriptions. The number of indexed color description 
data items depends on the number of unique color and light intensity values that exist in the scene description. A single 
indexed color description data item 262 is composed of an index field 264 and a color, or spectrum, data field 266 
containing color information. In illustrated data field 266, the color information is represented as RGB information, but 
any data format suitable for representing and encoding color information may be used. In the implemented embodiment, 
the color information is represented as an array of floating point numbers defining a color as a set of spectral samples. 
[0038] Each symbolic pixel expression represents all of the color contributions from objects and lights in the scene 
at that pixel, or, more precisely, the sum of the combined diffuse and specular reflections of the light propagated from 
the surface of an object to the observer's eye. To produce the symbolic pixel expressions 80, the symbolic rendering 
system multiplies together the spectra of the scene surfaces and the lights to form the components, or terms, of the 
symbolic expressions 80, called "basis spectra", which in turn are added to produce the color at each pixel. Each basis 
spectrum component term in a single expression also has an associated constant that depends on the geometry of 
the intersection and properties of the surface. Specifically, the expressions are made up of real numbers, arithmetic 
operators, parentheses, and color symbols (spectral references), as described in Sequin. For example, a color with 
the index of 3 may be referenced in a symbolic pixel expression simply as "s3". The parameters in each expression, 
when evaluated with actual color values, such as those provided in the original scene description 22, together define 
the spectral power density (SPD) of incident light at an image pixel. 

[0039] An example of how a symbolic pixel expression of component basis spectra terms is constructed by the 
symbolic rendering system illustrates this process more clearly. Assume that a scene description 22 consists of one 
illuminant with a spectrum designated as S^(X), and one surface with spectral reflectance function S 2 (X), where \ 
denotes wavelength. E(\) denotes the spectrum of a pixel that receives a ray that carries light from the illuminant and 
is reflected from a plastic surface into the pixel. The simple shading model of the renderer produces a relationship of 
the form: 

E(\)=c^(\)S 2 (\)+c 2 Si(\) (1) 

where the and c 2 are the scalar constants which are functions of the relative geometry of the illuminants and surfaces 
and the physical properties of the surfaces. Note that scalars q and c 2 are important for rendering the final image and 
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are shown for completeness, but are not important to the method of the present invention. The two terms on the right 
hand side of Equation (1 ) correspond to the diffuse and specular components of the light reflected from the plastic 
surface provided as the example. In more complex scene instances, additional "bounces" of a ray through the scene 
(i.e., the levels in the ray tree constructed by the ray tracer) results in additional spectra being multiplied together, 
resulting in turn in a high-order polynomial in the spectra. Actual experience with the implementation of the present 
illustrated embodiment shows that the ray tree usually does not exceed two or three levels, which prevents the order 
of the polynomials at the pixels from rising too high. 

[0040] FIG. 13 illustrates a representative data structure for symbolic pixel expression file 80. A single symbolic pixel 
expression 252, representing the color information for a single pixel in the color image, is composed of basis spectra 
terms 254 and arithmetic operators 256. Each basis spectra term 254 includes one or more data areas 258 for data 
produced by the symbolic rendering system not directly related to spectral data, such as the scalars and c 2 discussed 
above and one or more symbolic spectral components 260 which are, in effect, indices into indexed color description 
data items 84. The use of an indexing scheme to create indirect referencing between a symbolic pixel expression 252 
and color description data 84 is an efficient implementation over using actual color description data in the symbolic 
pixel expressions, and as noted earlier, any suitable indirect referencing arrangement may be used for associating the 
actual color and light intensity values in color description data 84 to the corresponding symbolic spectral components 
in the symbolic pixel expressions. The symbolic spectral components 260 are used for indexing into the indexed color 
description data 84, as shown by arrow 268, to retrieve the corresponding color information data, or spectrum data, 
needed to evaluate the symbolic pixel expression to produce the image pixel color. 

[0041] The basis spectra terms in each symbolic pixel expression are preferably converted to tristimulus values 
describing vectors in tristimulus space using a "tristimulus operator", T, such that T[E(X)} = x, where x is the three- 
vector containing the tristimulus values XYZ corresponding to E(X). If T [S 1 (^)S 2 W] = x 12 and T [S,(X)] - x v then 
applying the tristimulus operator to both sides of Equation (1 ) yields a linear combination of tristimulus vectors: 

T[E(X)] = fl^^W S Z (X) + c z S^(X)] (2) 



x= cJ[S^(X) S 2 (X)]+ c 2 T(S,(X)] (3) 



= c 1 x 12 + c 2 x 1 W 



[0042] When this conversion is performed is an implementation decision, and the basis spectra terms may be con- 
verted to tristimulus vector terms by the symbolic rendering system, after the ray tracing step, as in the illustrated 
embodiment or later, as an initial process in device directed rendering step 90. The final color of each pixel in the 
rendered image is thus defined, in the symbolic pixel expression, as the sum of one or more of the tristimulus vector 
terms. In the illustrated embodiment, then, color representation and manipulation is performed in the tristimulus color 
space model. Color representation and manipulation may also be carried out in other color spaces, since the tristimulus 
vectors may be converted further into other color models such as CIE color space models, and the RGB or HSV color 
models, through mathematical conversions well known in the art. Additional processing considerations must be taken 
into account, however, if a color space is used which is a nonlinear transformation away from the tristimulus color 
space model. 

[0043] The illustrated embodiment of the present invention is based on mathematical models shown in FIGS. 3 to 
8 The implementation of the mathematical models is handled as an optimization problem. Determining modifications 
to the original color descriptions in an efficient manner requires finding a set of optimal modifications to make to one 
or more of the color descriptions simultaneously which both produce an in-gamut, or target, color image and which is 
a valid target picture as defined by the image metric. Since, when suitable color descriptions are substituted for the 
symbols in the basis spectra terms, the symbolic pixel expressions ultimately determine all of the image pixel colors, 
the modifications to the original color descriptions can be efficiently determined indirectly, by manipulating the symbols 
representing the original color descriptions in the basis spectra terms in such a manner as to be able to apply the 
manipulations to the original color descriptions to determine the modified color descriptions. 
[0044] The mathematical model of the illustrated embodiment, to be described in detail below, is summarized as 
follows. The model defines an original rendered image, also known as the ideal image, as a "picture" represented in 
"picture space". The picture is defined as a function of the basis spectra (color descriptions 84). Each spectrum may 
be scaled by a weight to adjust its color. Because the spectra are physical representations of colors, the weights must 
meet certain criteria, and so, of all weights in "weight space", there is subset of weights which are valid. The subset of 
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valid weights when applied to the spectra produce a subset of valid pictures in picture space. Because a picture is a 
function of the spectra, and each spectrum is a function of one or more weights, a valid picture may be expressed as 
a continuous function of the weights, and the subset of valid pictures define a subset in picture space. A device gamut 
also defines a subset in picture space. A "target picture" is defined as a picture which has image pixel colors that are 

5 reproducible colors in the device gamut. The target picture may be found by applying a gamut mapping function to the 
original ideal image. There is some set of weights which meet the following constraints: the set of weights produces a 
valid picture in picture space; the picture produced is also in the device gamut of picture space; and the picture produced 
meets some objective function, called the image metric or "goodness function" which describes the desired relationship 
between the original picture in picture space and a target picture in the gamut subspace of picture space. Optimization 

10 of this mathematical model attempts to find the optima! set of values for the weights that are needed to meet these 
constraints. The details of this model follow. 

[0045] As noted above, in each symbolic pixel expression, tristimulus vector terms represent individual color contri- 
butions from object and light primitives in the scene to the final pixel color represented by the expression. The tristimulus 
vector terms, in turn, were converted from basis spectra, and so represent the scene spectra (objects and lights) which 
15 affect the color in the particular pixel represented by the expression. Typically, the basis spectra occur as terms in 
multiple symbolic pixel expressions, because the lights and the objects in the scene influence the color in many indi- 
vidual pixels. 

[0046] Figures 3 and 4 illustrate the concept of basis spectra as vectors in the color model known as tristimulus 
space. Note that FIGS. 3 and 4 illustrate a two-dimensional example, simplified from the three-dimensional model 

20 implemented in the illustrated embodiment, and that the vectors shown demonstrate only one of the possible symbolic 
expressions for a pixel. In FIG. 3, dotted line box 120 represents the volume of tristimulus space. Within tristimulus 
space 120, a subset 122 of tristimulus space represents the gamut of a particular output medium, also denoted"G M in 
FIG. 3. The color of a light source, L, in the image to be rendered is represented by the vector in tristimulus space 120 
denoted S L . Similarly, the color of a surface, S s , illuminated by light source, L, in the image is represented by the 

25 product of S s and S L , denoted S S S L . A pixel 1 24 in the image has a color which is determined by the sum of S S S L and 
S L . Pixel 124 happens to be outside of gamut 122. 

[0047] For the case where the color of any pixel in the rendered image is out of gamut, the individual scene spectra, 
S, for either the object surfaces (S s ) or the light intensities (S L ), or both, in the symbolic pixel expression which generated 
the out-of-gamut pixel, are adjusted, or scaled, by a weight, w, in order to bring the vectors representing the scene 
30 spectra closer to the volume bounded by gamut G. In an initial processing step of device directed rendering method 
90, each spectral function Sj(X) (an original color description symbol or index) in Equation (1) is replaced with WjSj(^), 
a weighted color description symbol or index. Applying the tristimulus operator T to both sides of Equation (1 ), as done 
above in Equations (2), (3), and (4), yields: 

35 

x = (c 1 x 12 )w 1 w 2 +(c 2 x 1 )w 1 (5) 



Because x is a tristimulus vector, Equation (5) defines three equations, each a polynomial in the weights. 
[0048] Figure 4 illustrates how individual weights applied to scene spectra bring individual pixels into the gamut of 
the output medium. Pixel 124 and gamut 122 are shown in the same positions they have in tristimulus space 120 of 
FIG. 3. In the illustrated embodiment, a pixel defined by a single vector can only be brought into gamut if the line along 
the vector intersects the device gamut. Thus, if the pixel color at point 124 in tristimulus space were defined only by a 
single vector along line 1 24a, a single weight applied to the vector would not be able to bring the pixel color into gamut 
122, since it would scale the color only along line 124a. However, since pixel 124 in FIG. 3 is defined as a sum of 
vectors, the pixel color can be corrected (i.e., brought into gamut 122) by scaling the weights of the light source and 
surface spectra as long as the plane or volume bounded by the vectors intersects the device gamut. In FIG. 3, in 
essence, vector S S S L has been scaled with weights having values of one (1). In FIG. 4, two corrections are shown. 
The basis spectrum of light source, L, has been scaled by weight w L and the product of the spectrum and the weight 
results in a new vector in tristimulus space 120, denoted w L S L . Weight, w L , has also been applied to the spectrum of 
light source L in basis spectrum (product vector) S S S L Scaling the spectra with weight w L will change the pixel value 
in a manner defined by the rules of vector algebra. Thus, the new product vector in tristimulus space 120 denoted 
w L S s S L represents a pixel color that has changed from position 124 to position 126 in tristimulus space. Because only 
a single weight has been applied, the scaling results in pixel color 124 changing along line 124a to point 126, toward 
the origin point of gamut 122. In effect, such a change only results in changing the brightness of the pixel color, and 
not its chromaticity. Pixel color 126 is closer to the boundary of gamut 122, although it is still an out of gamut color. 
Applying weight w s and scaling the spectrum of surface S s results in a new product vector in tristimulus space 120, 
denoted w s w L S s S L , representing a new pixel color 128 in tristimulus space which is now within the boundary of gamut 
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122. Pixel color 128 is now capable of reproduction in the selected output medium represented by gamut 122. 
[0049] In the weight system of the illustrated embodiment, there is a single weight for each spectral function, and 
each weight must meet certain constraints. If the total number of weights is M, each weight is mathematically repre- 
sented as a component of M-dimensional vector, w. A particular set of weights defines a point in an M-dimensional 
5 Euclidian "weight space". Because the spectral functions have a physical interpretation, they cannot be scaled arbi- 
trarily. The weight that scales a spectral function must be chosen so that the scaled spectral function is physically 
realizable. In general, weights are positive and nonzero. Surface reflectance functions cannot have values greater than 
1 .0. Wdenotes the subset of M-dimensional weight space containing all possible w's that produce physically realizable 
scaled spectral functions. 

10 [0050] Figure 13 illustrates a representative data structure for a single symbolic pixel expression 270 scaled with 
weights. A single unique weight 272 is assigned to each symbolic spectral component 260 in expression 270. As a 
weight takes on values, it functions as a multiplier on the symbolic spectral component 260 to which it is assigned. In 
turn, the multiplier is applied to the actual color information 266 in indexed color description data 84 when symbolic 
spectral component 260 is used to index into indexed color description data 84 during evaluation of expression 270. 

15 [0051] Figures 5 to 8 conceptually illustrate the mathematical model of the problem statement. The N image pixel 
colors which result from evaluating the symbolic pixel expressions 80 each have three tristimulus values per pixel, and 
are collectively designated as a "picture" in "picture space". The N image pixel colors of the picture are represented 
by vector p. Vector p is a long vector comprised of 3N tristimulus values, built from a picture in scan-line order, and Pj 
denotes the i th component of p, corresponding to one tristimulus value at one pixel. The set of image pixel colors 

20 evaluated from the symbolic pixel expressions 80 with the current object and light intensity values is designated as the 
picture, p 0 . Since the spectra are functions of the weights, and the picture is a function of the spectra, a picture function, 
f, is defined which maps weights to tristimulus values in pixels. The picture function is denoted as p = f(w). P is the 
subset of "picture space" containing all pictures for which there exists a weight vector w in weight space W such that 
p = f(w). The picture function is vector-valued, and f x denotes the i th component function of p. Each component function 

25 is a low-order polynomial function in the weights, as illustrated by Equation (5), and thus is continuous and has easily 
computable derivatives of all orders. 

[0052] A linear approximation to the picture function is developed which is used to search for the optimal set of 
weights to bring the picture into gamut. The matrix of first partial derivatives of the picture function, fl[w), is a Jacobian 
matrix having dimensions of 3N x M, where the entry on the I th row and j th column is the partial derivative of % with 
30 respect to w= (the j th component of w). This Jacobian matrix is denoted J f . Because f is nonlinear, J f will depend on w. 
[0053] The linear approximation to p = f(w) is formed by truncating the Taylor series expansion of f after the second 
term: 



35 



p + Ap = f(w + Aw) (6) 

p + Ap « f(w)+JfAw ( 7 ) 

<o Because p = f(w), the approximation that is made is Ap « J/Aw. 

[0054] The linear approximation just described is used to find the changes in the vector of weights, w 0 , of the current 
picture function, p 0 , that are needed to satisfy the picture function that represents the target picture, p\ Target picture 
p* is also a function of a set of weights, designated as target weights w*. such that p* = f(w*) The target picture p* is 
produced by mapping the ideal or current picture to the gamut of the device (described in more detail below), so p* is 

45 not necessarily in P, since there may be no w* such that p* = f(w*). In the implemented embodiment, the target weights 
w* are defined to be the weights needed to minimize some measure of distance between p* and the picture function 
f(w 0 ). The weights. w 0 , are already known, since p 0 = f(w 0 ). Thus, the linear approximation ofthe picture function is 
used to find the changes in the weights needed to minimize some measure of distance between p* and the picture 
function f(w 0 ). This distance is defined as a distance function, d(p*. f(w)), and is the image metric hereafter referenced 

50 as the objective or goodness function, of the optimization problem. 

[0055] FIG. 5 illustrates the subset P of picture space, a target picture, p* which is not in P, and the picture in P, 
designated by picture function flw*), which is the closest, in Euclidian distance, to the target picture. In the implemented 
embodiment, the distance function which produced acceptable picture results is defined as: 



55 



d(p\f(w)) = ||p* - f(w) f ( 8 ) 
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where || • || denotes Euclidian distance. Thus, the distance between two pictures is measured by the squared Euclidian 
distance between them in picture space. Other goodness functions are also possible, and may be preferable to the 
distance function of Equation (8) for certain images or certain device gamuts. For example, a goodness function which 
describes the minimum distance from p to the most perceptually acceptable substitute for p* in G is a desirable good- 
ness function. 

[0056] The gamut of the designated output medium is the region of three-dimensional tristimulus space, denoted 
Gj, that the device can render. A picture, p, is in gamut when all of its pixels are in gamut. All in-gamut pictures form 
a subset, G, of picture space P. There exists a "gamut projector" function, h, which maps a picture p 0 to the picture in 
G"closest" in Euclidian distance to p 0 . Figure 7 illustrates picture p 0 and the picture, h(p 0 ) in G "closest" in Euclidian 
distance to p 0 Some picture p is the picture that minimizes d(p 0 , p) over all p in G. Note that gamut projector function 
h is the identity operator when p 0 is already in G:h(po) = p for p 0 G G. 

[0057] Figure 6C illustrates one solution to the stated problem. In the search for the changes to the weights, w, for 
the picture that minimizes d(p 0 , p) over all p in G, first the gamut projector function h is applied to the picture p 0 to 
obtain the target picture p* = h(p 0 ). By the definition of h, p* is in gamut, but it may not be in P. Then, a nonlinear 
minimization process (described in detail below) is used to find changes in weights, w, which move picture p 0 in P 
toward p*. The goal of these two steps is to end at f(w*) which defines the picture in G which is the smallest distance 
from p*. Since p* is fixed, the distance that must be found depends only on w. In effect, the problem is to minimize a 
function g(w) = d(p*, f(vi)) with respect to w. The function is nonlinear, and a variety of nonlinear optimization techniques 
are applicable to the problem. 

[0058] The problem of finding the optimum set of weights with which to scale the spectra to produce an in-gamut 
picture can now be briefly restated in the following form. Given an initial picture p 0 , and an initial set of weights, w 0 , 
such that p 0 = f(w), the problem is to find the p that minimizes the distance d(p 0 , p) over all p e P n G. For a picture 
p to be in the set P n G, p must be in gamut, and there must be a w E W such that p = f(w). 
[0059] The specific steps of the implemented nonlinear optimization technique are as follows. When the distance d 
(p*, f(w*)) is not expected to be too large at its minimum, the Gauss-Newton method may be used to find w*. The 
method is discussed by P. Gill, W. Murray, and M. Wright in Practical Optimization, at pages 134 - 136. The method 
produces a sequence of w's which converge to w*. At each iteration, the next w is computed by choosing a direction 
in which to step w and a length for the step. The Jacobian of f, J f , is used to compute the step directions, essentially 
linearizing the problem around the current value of w. Table 1 shows the general steps of the implemented method. 



TABLE 1 


Steps in Gauss-Newton Method 


1. 


Evaluate Jf at w it and let Apj = p* - Pj; 


2. 


Choose step direction AWj to minimize ||Apj - J^Aw, || as follows: 




AWj = J/+Apj where is the pseudo inverse of J f \ 


3. 


Choose a step length, k, according to an estimate of how nonlinear f is; 


4. 


Let Wj + 1 <- Wj + kAWj; let p, + 1 <r- (f(Wj + .,);. 


5. 


If the sequence {pj} has converged, exit; else let i «- i + 1 and return to step 1 . 



[0060] Figure 8 illustrates that the steps just described alone will not guarantee that the picture which is the smallest 
distance from p* will be in G. Using the two steps just described results in picture p 1 being the closest picture to /)(p 0 ), 
but p 1 is not in G. A third step guarantees that the picture which is the smallest distance from p* will be in G. At every 
step in the nonlinear minimization process used to find weights, w, which move picture p 0 in P toward p*, the target 
picture p* is also recomputed so that there is a sequence of target pictures, p* = n(Pj), as shown in FIG. 8. As long as 
there is some way to move the weights, w, the successive pictures, p h in P will continue to move in P toward the 
recomputed target pictures, pf, into G, ending at Pj as shown. 

[0061] It can be seen from the process just described and from its illustration in FIG. 8, that the process implemented 
in the illustrated embodiment does not necessarily keep the recomputed target picture p*j close to the originally com- 
puted target picture p* 0 in G. The final p*j will not in general equal the initial one. The strategy just described treats all 
p in Pn G as equally good final in-gamut pictures, without regard to their distance from the original image. There may, 
however, be a modification to the model as implemented which would have as its goal finding the p in P n G which is 
the "closest" to the original image, p 0 . 

[0062] Figure 9 illustrates the steps in the implemented embodiment of device directed rendering method 90 which 
uses the mathematical model of the picture function to produce a semantically consistent color image with in-gamut 
pixel colors. First, in box 1 30, each scene spectrum in each of the symbolic pixel expressions 80 is assigned a variable 
representing the value for the weight on that spectrum, producing for each pixel expression an equation in the form of 
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Equation (5) expressing the pixel color value as a function of the weights. The weights are also initialized from the 
input spectra. The input spectra are read from a vector n, and the values for the weights are stored in a vector w. The 
resulting scaled spectra are stored in vector s . If the input spectrum , n^) is an illuminant, the value of the corresponding 
weight w, is initially set to one (1), and the spectrum Sj <- nj. The values for input spectra which are illuminants must 
5 be positive, and may be greater than one (1). Otherwise, the input spectrum, n^) is a reflectance. The value for a 
spectrum which is a reflectance must fall between zero and one, and so the value of the corresponding weight Wj is 
initially set to the largest input spectra value, and the spectrum Sj <- ^ / w h Thus, the largest value a weight may take 
on for a reflectance spectrum is one (1 ). 

[0063] Other initialization functions may be performed in box 130 as well. For example, a number of user-specified 
10 thresholds are used to control subsequent processing steps, and these may be requested interactively from the user 
or otherwise entered into memory at this point. 

[0064] In box 132, the symbolic pixel expressions 80 are then evaluated to produce a vector of evaluated pixels 
represented as tristimulus values. Evaluation step 132 is substantively similar to evaluation step 82 in FIG. 2, with 
modifications for handling the evaluated pixel expressions as a vector of spectral color information. The entire vector 

15 of values at this point is the initial picture, p 0 , also called the "ideal" image, as produced by the symbolic rendering 
system. All of the color and light intensity values in each symbolic pixel expression 80 which generate out-of-gamut 
pixel colors may be modified simultaneously, in the processing which follows. Typically, processing time and other 
implementation dependent decisions affect whether to modify all out-of-gamut colors at one time. In the illustrated 
embodiment, a selection of the "worst" pixel colors is made from all of the out-of-gamut pixels to reduce computational 

20 time. When these worst pixels are brought into gamut by adjusting the weights on the spectra, the picture is evaluated 
again, and a new set of "worst" pixels is selected for processing. The outer loop controls the selection of the worst out- 
of-gamut pixels, and an inner loop minimizes the picture function to bring the pixels in-gamut. However, all out-of-gamut 
pixels could be adjusted simultaneously, if computational time and system resources permit. 
[0065] The number, b, of "worst" pixel colors selected is arbitrary, and is primarily influenced by performance con- 

25 straints. The manner for selecting the pixels, in boxes 1 34 and 1 36, is as follows. Each evaluated pixel color is mapped 
to the device gamut to determine (a) whether the pixel is out-of-gamut; and (b) for each pixel that is out-of-gamut, (i) 
what the closest, in-gamut pixel color is, and (ii) what the distance is in the color space between the out-of-gamut color 
and the closest in-gamut color. The list of out-of-gamut pixels is sorted in descending order by distance, and the b 
number of pixels having the largest distance values are selected for processing. The symbolic pixel expressions 80 

30 with weighted spectra which represent these worst pixels form the basis of the picture function, p 0 , which is the current 
ideal image. 

[0066] In box 138, the inquiry is made whether all, or substantially all, of the pixels just evaluated are in the gamut 
of the designated output medium. This inquiry controls the outer loop of processing. When all pixels are in-gamut, 
processing is concluded, and the current set of evaluated pixels colors represent a color image which is semantically 

35 consistent and which has image pixels that are within the gamut of the output medium. Control then transfers to box 
154, where the file of modified indexed color description data is produced. The current values for the weights contain 
the scale factors to be applied to the original indexed color descriptions (file 84 in FIG. 1 ) to produce the modified color 
description data (file 86 in FIG. 1). The process in box 154 applies each weight to its corresponding original color 
description according to the index in the symbolic pixel expression, and writes a data structure of modified color infor- 

40 mation data with corresponding indices. 

[0067] The inquiry in box 138 may also permit the user to specify some user threshold to terminate processing. This 
threshold may specify for example, that each evaluated pixel must be within some small range of distance from the 
gamut (a "close enough" threshold), or that some percentage of pixels must be within the gamut to conclude processing. 
[0068] When the inquiry in box 138 is not satisfied, the symbolic expressions of the picture function, p 0 , defined by 

45 the b selected pixels, are differentiated with respect to the weights to form the Jacobian matrix, in box 140, and inner 
loop processing begins in box 142. The inner loop processing represents the specific processing steps needed for 
minimizing the goodness function, which in the illustrated embodiment is the squared Euclidian distance between two 
pictures in picture space. As noted above, the Jacobian matrix relates movements of the pixels to movements of the 
weights: J,Aw, = Ap,. The expression for each pixel in this matrix contains symbolic expressions Wj for weights on the 

50 spectra. 

[0069] In box 142, p 0 is now denoted as p jt since minimizing the distance between two pictures may take several 
iterations of the inner loop, and with each iteration Pj changes as weights are adjusted. In box 142, p jf the set of the b 
worst pixels, is evaluated with respect to the current settings of the weights. These evaluated pixels are then mapped 
to the device gamut in box 144, using gamut projector function, h, which may be any conventional gamut mapping 
55 method. The mapping to the gamut of picture Pj produces a target picture p*. a list of in-gamut pixels. Then, also in 
box 142, the difference Ap between each pixel color in the current picture Pj and the target picture p* is computed. 
[0070] ' In boxes 146 and 148, the specific Jacobian matrix for picture p { is constructed and its pseudo-inverse com- 
puted, using any standard technique, to find the direction in which to move the weights to bring the current picture 
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closer to the target picture in picture space. In box 150, a step size is selected for the weights, according to how 
nonlinear picture function f(Wj) is. In the illustrated embodiment, the step size takes on a user-specified value m between 
0 and 1 . If the largest absolute value in the vector of weight changes computed from the pseudo-inverse of the Jacobian 
is greater than ro, the step size is set to m; otherwise, the step size is set to one (1). The new weights are found from 
5 w, +1 <- Wj + kAWj. 

[0071] In box 152, an inquiry is made as to whether the inner loop processing is completed. In essence the inquiry 
is whether the current picture of the b worst pixels from the outer loop satisfies the goodness function. The inquiry is 
made here because the most recent set of computed changes for the weights provides information as to how the 
current picture is "converging" on the target picture. The specific inquiry in box 152, then, includes two tests. The first 

10 is whether the absolute value of the largest distance difference between the current picture and the target picture is 
within a user-specified distance. The second is whether the absolute value of the largest change in the weights com- 
puted from the Jacobian pseudo-inverse is smaller than a user-specified quantity, that is, too minimal to try another 
iteration of weight changes. If either test is true, processing of the inner loop is terminated, and processing continues 
in box 1 32. If either test is not true, however, the distance function may be minimized further, and processing is trans- 

15 ferred to the top of the inner loop at box 142. 

[0072] The method of the present invention may be used for operating a processor-controlled machine, such as a 
general purpose digital computer or a machine having a digital computer as a component part. In addition, the present 
invention may be a machine which includes a processor for executing instructions which accomplish substantially 
similar results as the method of the present invention. Figure 1 0 illustrate a machine configuration for which the present 

20 method and machine inventions are suitable. Figure 10 is a simplified functional block diagram illustrating the compo- 
nents of a processor-controlled machine 200 (hereinafter, "system 200"). System 200 may be a standalone system, 
such as a microcomputer-based graphics workstation, which is suitable for performing the scene modeling and creation 
of the scene description, the rendering of the image with a symbolic shaded rendering system, the spectral change 
calculations method 90 of the present invention, and display of the in-gamut final color image on output device 49. The 

25 components of system 200 include a processor 204 and at least one memory unit 202. Memory unit 202 includes ROM 
and RAM in which are stored the program instructions for the scene modeling application, the rendering system, spectral 
change calculator 90, and the symbolic pixel expression evaluator. Memory 202 also stores data that may be needed 
during execution of the program instructions, including the scene description 22, indexed color description data 84, 
the symbolic pixel expressions 80, and device gamut data 44. 

30 [0073] In system 200, processor 204 is connected for access to and in communication with a respective memory 
unit, and processor 204 controls the execution of program instructions and the retrieval of data from the memory. 
Processor 204 may be any appropriate processor and, in use, it controls the transfer of pixel information signals rep- 
resenting pixel image data from memory to output circuitry which includes output unit 49. 

[0074] Input unit 206 may include any suitable device and associated input circuitry for interacting with a scene 
35 modeling application, a rendering system 25, and spectral change calculator 90. Suitable devices include but are not 
limited to pointing and cursor control devices for two- and three-dimensional displays, such as a mouse or light pen, 
alphanumeric input devices such as a keyboard, and touch screen displays. 

[0075] The output units of system 200 may be any appropriately connected color device suitable for displaying com- 
puter generated color image data, such as a cathode ray tube (CRT) raster scan color monitor or a color liquid crystal 

40 display. Other devices suitable as output units in place of display 49 include color reproduction devices, such as an 
electronic or digital printer, xerographic marking engine, platemaking device, or other suitable color rendering device. 
In addition, the output unit may be a data communications device for connecting to a communications line, as shown 
in FIGS. 11 and 12, whereby data created according to the method of the present invention may be transmitted to other 
suitably configured systems for further processing or for display or reproduction. 

45 [0076] In FIG. 11 , in an alternative embodiment of the present invention, another machine configuration having two, 
similarly configured, processor-controlled machines is illustrated. System 200 is connected to system 210 through 
communications link 209, which may be any conventional network communications connection between the two ma- 
chines. System 200, which may be a graphics workstation, is operated to execute rendering system instructions 25 to 
generate symbolic pixel expression file 80 and indexed color description data 84, which together represent the data 

50 needed for a rendered color image, and which may be stored in memory 202. Processor 204 controls the communication 
of symbolic pixel expression file 80 and indexed color description data 84 to receiving system 210 through output unit 
208 configured as a communications connection. The receiving system 210, which may be a networked, microcomputer 
or workstation, receives symbolic pixel expression file 80 and indexed color description data 84 from system 200 
through communications link 209, and executes spectral change calculation instructions 90 and symbolic pixel expres- 

55 sion evaluator instructions 82 to produce the in-gamut image pixel color data 46 needed for displaying the in-gamut 
rendered color image on output display 49 of system 210. 

[0077] A second alternative embodiment is shown in FIG. 12: there is illustrated still another machine configuration 
having three processor-controlled machines connected through communications links 209 and 219. This implementa- 
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tion is described in detail in Ref. 1 with reference to FIG. 10 thereof. 

[0078] Other machine implementations of the functional steps of the method of the present invention are also pos- 
sible For example, in FIG. 12, system 210 could also generate the in-gamut image pixel color data 46 using symbolic 
pixel expression evaluator 82, thereby creating the data which represents the final color image having colors which 
5 are in the gamut of designated output medium 49 of system 220. System 220 could then receive the in-gamut image 
pixel color data 46 through communications link 21 9, for display on output medium 49 without further processing. The 
dotted line 88 of FIG. 1 represents the combination of spectral change calculator process 90 with symbolic pixel ex- 
pression evaluator process 82 implemented on a single machine. 

[0079] The method of the present invention was implemented on a Sun Microsystems SPARCstation Model 2 with 
w a 24 bit color display, running the Unix BSD 4.2 operating system. The renderer used in the illustrated embodiment 
was implemented as a ray tracing rendering method from a simple public domain ray tracer, available at the time of 
implementation via anonymous ftp from "princeton.edu" under the name of "MTV. 

[0080] The gamut projector function h may be implemented as any suitable gamut mapping process known in the 
art In the illustrated embodiment, a very simple gamut mapping process is used which projects each out-of-gamut 

15 pixel in the current ideal image, picture p 0 , onto the position in the gamut in RGB color space closest to the out-of- 
gamut pixel position. Table 2 of Ref. 1 contains the program code, in Mathematics, to implement this simple gamut 
projector function to find the signed distance from an ideal image pixel color to the closest point in the RGB color space: 
[0081] FIGS. 12A and 12B of Ref. 1 contain an example of the program code, in Mathematica, designated as refer- 
ence numeral 160 in both figures, to implement the steps shown in FIG. 9. 

20 [0082] The present invention furthermore encompasses variations of the above described embodiments which will 
be apparent to persons skilled in the art and, for example, as described on pp. 55-57 of Ref. 1 . 



Claims 



25 



1 . A method of rendering a colour image from symbolic image data, comprising: 

performing spectral change calculations with symbolic color image data representing the interplay of light and 
object primitives in the original image; indexed color description data indexed to the symbolic color image data, 
and device gamut color data representing a gamut of device colors of a color reproduction device to produce 
30 modified color description data; the modified color description data, when used to evaluate the symbolic color 

image data, generating a color image composed of a plurality of in-gamut colors; each in-gamut color being one 
of the device colors in the gamut of the color reproduction device; thereby producing a rendered image which is 
semantical^ consistent with the interplay of hight and object primitives of the original image. 

35 2. The method of claim 1 wherein performing spectral change calculations includes the steps of: 

(a) determining color modification data to be used to modify the indexed color description data; 

(b) evaluating the symbolic color image data with the indexed color description data and the color modification 
data to generate a color image composed of modified colors; 

40 (c) generating a target color image from the color image using the device gamut color data; each of a plurality 

of target colors composing the target color image being one of the device colors in the gamut of the color 
reproduction device and corresponding to one of the modified colors of the color image; 
(d) determining whether the color image satisfies an image metric measuring a valid color image in terms of 
a relationship between the color image and the target color image; 

4 5 (e) if the color image does not satisfy the image metric, repeating steps (a), (b), (c), and (d) until the color 

image satisfies the image metric; and 

(f) modifying the indexed color description data with the color modification data to produce the modified color 
description data. 

so 3 The method of claim 2 wherein the image metric measures the valid color image according to a distance in a color 
space between one of the modified colors in the color image and the corresponding target color in the target color 
image 

4. The method of claim 1 wherein performing spectral change calculations includes the steps of: 

55 

(a) assigning change variables to symbolic color image data items; 

(b) evaluating the symbolic color image data items with indexed color description data items to generate a 
current color image composed of current colors; 
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(c) generating, from the current colors of the current color image, a target color image using device gamut 
color data; 

(d) calculating difference data between the current colors and the target colors; 

(e) determining incremental change quantities for the values of the change variables using the difference data; 
5 (f) determining from the difference data and from the incremental change quantities whether the current color 

image satisfies image metric data; the image metric data including relationship data for measuring a valid color 
image in terms of a relationship between the current color image and the target color image, and change 
variable data for measuring a minimum acceptable quantity for the incremental change quantities; 

(g) if the current color image does not satisfy the image metric data, updating the current values of the change 
10 variables with the incremental change quantities, and repeating steps (b), (c), (d), (e), (f) and (g); and 

(h) applying the current values of the change variables to the indexed color description data to produce modified 
color description data. 

5. The method of claim 4 wherein the relationship data of the image metric data measures the current color image 
15 according to a distance in a color space between one of the current colors in the current color image and the 

corresponding target color in the target color image. 

6. The method of claim 1, running on a machine including: 

20 a memory for storing data; and 

a processor connected for accessing and storing data in the memory; 
the data stored in the memory including 

indexed color description data items; each indexed color description data item defining an original color of one 

of a plurality of object primitives in a scene description; 
25 symbolic color image data items having symbolic spectral components indexing the indexed color description 

data items to the symbolic color image data items; each symbolic color image data item defining one of a 

plurality of image pixel color data items composing a color image rendered from the scene description; 

device gamut color data items representing for a color reproduction device a gamut of device colors capable 

of reproduction by the device; and 
30 image metric data representing a desired relationship between the plurality of image pixel color data items 

composing the color image and a plurality of target image pixel color data items composing a target color image; 

wherein performing spectral calculations comprises the following steps carried out by the processor: 

35 (a) assigning change variables to the symbolic spectral components in the symbolic color image data items 

stored in the memory of the machine; 

(b) determining a new value for at least one change variable to produce modified symbolic spectral compo- 
nents; 

(c) evaluating each modified symbolic spectral component of each symbolic color image data item with the 
40 indexed color description data items to produce the image pixel color data items composing the color image; 

(d) generating the plurality of target image pixel color data items composing the target color image from the 
image pixel color data items composing the color image using the device gamut color data items; each target 
image pixel color data item representing one of the device colors capable of reproduction by the device; 

(e) determining if the color image satisfies the relationship represented by the image metric data; 

45 (f) if the color image does not satisfy the image metric data, repeating steps (b), (c), (d), and (e) until the color 

image satisfies the image metric data; and 

(g) applying the new value of each change variable to the indexed color description data item indexed to the 
symbolic spectral component to generate a plurality of modified indexed color description data items. 

50 7. The method of claim 6, wherein the step (b) includes the steps of (b.1) determining an incremental change quantity 
from a current value of the change variable; and b.2) applying the incremental change quantity to the current value 
of the change variable to obtain the new value. 

8. A machine for rendering a colour image from symbolic image data comprising: input circuitry for obtaining symbolic 
55 color image data items representing the interplay of light and object primitives in the original image and indexed 

color description data items; each indexed color description data item defining an original color of one of a plurality 
of object primitives in a scene description; each symbolic color image data item defining one of a plurality of image 
pixel color data items composing a color image rendered from the scene description; the symbolic color image 
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data items having symbolic spectral components indexing the indexed color description data items to the symbolic 
color image data items; 

memory for storing data; 

output circuitry for connecting the machine to an output medium and for transferring selected data from the 
memory to the output medium; and 

a processor connected for accessing the input circuitry to receive the symbolic color image data items and 
the indexed color description data items and to store the symbolic color image data items and the indexed 
color description data items in the memory; the processor further being connected for accessing the output 
circuitry to transfer the selected data from the memory to the output circuitry; 

the processor further being connected for accessing data stored in the memory; the data stored in the memory 
including: 

device gamut color data items representing a gamut of device colors capable of reproduction by a color re- 
production device; and instruction data indicating instructions the processor executes; 
the processor, in executing the instructions, performs spectral change calculations with the symbolic color 
image data items, the indexed color description data items, and the device gamut color data items to produce 
modified color description data items capable of producing, together with the symbolic color image data items, 
the plurality of image pixel color data items composing the color image, each image pixel color data item 
representing one of the device colors in the gamut of the color reproduction device; the processor further, in 
executing the instructions, stores the modified color description data items in the memory; thereby a rendered 
image is produced which is semantically consistent with the interplay of hight and object primitives of the 
original image. 

9 The machine of claim 8 herein the processor further, in executing the instructions, (1) selects the modified color 
description data items and the symbolic color image data items in the memory and transfers the selected data 
items from the memory to the output circuitry; the output circuitry transferring the modified color description data 
items and the symbolic color image data items to the connected output medium or (2) evaluates the symbolic color 
image data items with the modified color description data items to generate the image pixel color data items com- 
posing the color image; and wherein the processor further, in executing the instructions, transfers the plurality of 
image pixel color data items to the output circuitry for transferring to the output medium. 

10 The machine of claim 8 or 9 wherein the output medium is (1) the color reproduction device having the gamut of 
device colors represented by the device gamut color data items stored in the memory of the machine or (2) a data 
communications circuit. 



Patentanspruche 

1. Verfahren fur das Rendering eines Farbbildes aus symbolischen Biiddaten, welches umfalit: 

Durchfuhren von Berechnungen von Spektralanderungen mit symbolischen Farbbilddaten, welche das Zu- 
sammenspiel von Licht- und Objektprimitiven im Originalbild wiedergeben; indizierten Farbbeschreibungsdaten, 
welche auf die symbolischen Farbbilddaten indiziert sind, sowie Geratefarbpalettedaten, welche die Farbpalette 
der Geratefarben eines Farbwiedergabegerates wiedergeben, urn modifizierte Farbbeschreibungsdaten zu erzeu- 
gen wobei die modifizierten Farbbeschreibungsdaten, wenn sie zum Bewerten der symbolischen Farbbilddaten 
verwendet werden, ein Farbbild erzeugen, das sich aus einer Vielzahl von Farben in der Farbpalette zusammen- 
setzt wobei jede Farbe in der Farbpalette eine der Geratefarben in der Farbpalette des Farbwiedergabegerates 
ist, urn dadurch ein gerendertes Bild zu erzeugen, das semantisch konsistent mit dem Zusammenspiel von Licht- 
und Objektprimitiven des Originalbildes ist. 

2. Verfahren nach Anspruch 1 , wobei das Durchfuhren der Berechnungen von Spektralanderungen folgende Schritte 
umfafit: 

(a) Bestimmen von Farbmodifikationsdaten, welche zum Modifizieren der indizierten Farbbeschreibungsdaten 
verwendet werden, 

(b) Bewerten der symbolischen Farbbilddaten mit den indizierten Farbbeschreibungsdaten und den Farbmo- 
difikationsdaten, urn ein Farbbild zu erzeugen, das sich aus modifizierten Farben zusammensetzt, 
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(c) Erzeugen eines Zielfarbbildes aus dem Farbbild unter Verwendung der Geratefarbpalettedaten, wobei jede 
aus der Vielzahl von Zielfarben des Zielfarbbildes eine der Geratefarben in der Farbpalette des Farbwieder- 
gabegerates ist und einer der modifizierten Farben des Farbbildes entspricht, 

(d) Bestimmen, ob das Farbbild eine Bildmetrik erfullt, die ein gultiges Farbbild in den Termen einer Beziehung 
zwischen dem Farbbild und dem Zielfarbbild mifit, 

(e) wenn das Farbbild die Bildmetrik nicht erfullt, Wiederholen der Schritte (a), (b), (c) und (d), bis das Farbbild 
die Bildmetrik erfullt, und 

(f) Modifizieren derindizierten Farbbeschreibungsdaten mitden Farbmodifikationsdaten, urn die modifizierten 
Farbbeschreibungsdaten zu erzeugen. 

Verfahren nach Anspruch 2, wobei die Bildmetrik das gultige Farbbild in Ubereinstimmung mit einer Distanz in 
einem Farbraum zwischen einer der modifizierten Farben im Farbbild und der entsprechenden Zielfarbe im Ziel- 
farbbild miftt. 

Verfahren nach Anspruch 1 , wobei das Durchfuhren von Berechnungen von Spektralanderungen folgende Schritte 
umfaftt: 

(a) Zuweisen von Anderungsvariablen zu symbolischen Farbbilddatenelementen, 

(b) Bewerten der symbolischen Farbbilddatenelemente mit indizierten Farbbeschreibungsdatenelementen, 
urn ein aktuelles Farbbild zu erzeugen, das sich aus aktuellen Farben zusammensetzt, 

(c) Erzeugen eines Zielfarbbildes aus den aktuellen Farben des aktuellen Farbbildes unter Verwendung der 
Geratefarbpalettedaten , 

(d) Berechnen von Differenzdaten zwischen den aktuellen Farben und den Zielfarben, 

(e) Bestimmen von inkrementellen Anderungsquantitaten fur die Werte der Anderungsvariablen unter Ver- 
wendung der Differenzdaten, 

(f) Bestimmen aus den Differenzdaten und aus den inkrementellen Anderungsquantitaten, ob das aktuelle 
Farbbild die Bildmetrikdaten erfullt, wobei die Bildmetrikdaten Beziehungsdaten zum Messen eines gultigen 
Farbbildes in den Termen einer Beziehung zwischen dem aktuellen Farbbild und dem Zielfarbbild sowie An- 
derungsvariablendaten zum Messen einer minimalen annehmbaren Quantitat fur die inkrementellen Ande- 
rungsquantitaten enthalten, 

(g) wenn das aktuelle Farbbild die Bildmetrikdaten nicht erfullt, Aktualisieren der aktuellen Werte der Ande- 
rungsvariablen mit den inkrementellen Anderungsquantitaten und Wiederholen der Schritte (b), (c), (d), (e), 
(f) und (g), und 

(h) Anwenden der aktuellen Werte der Anderungsvariablen auf die indizierten Farbbeschreibungsdaten, urn 
modifizierte Farbbeschreibungsdaten zu erzeugen. 

Verfahren nach Anspruch 4, wobei die Beziehungsdaten der Bildmetrikdaten das aktuelle Farbbild in Obereinstim- 
mung mit einer Distanz in einem Farbraum zwischen einer der aktuellen Farben im aktuellen Farbbild und der 
entsprechenden Zielfarbe im Zielfarbbild messen. 

Verfahren nach Anspruch 1, das auf einem Gerat ausgefuhrt wird, welches umfaftt: 
einen Speicherzum Speichern von Daten, und 

einen Prozessor, der zum Zugreifen und Speichern von Daten im Speicher verbunden ist, 
wobei die im Speicher gespeicherten Daten umfassen: 
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indizierte Farbbeschreibungsdatenelemente, wobei jedes indizierte Farbbeschreibungsdatenelement eine 
Originalfarbe von einem aus einer Vielzahl von Objektprimitiven in einer Szenenbeschreibung definiert, 

symbolische Farbbilddatenelemente mit symbolischen Spektralkomponenten, welche die indizierten Farbbe- 
schreibungsdatenelemente auf die symbolischen Farbbilddatenelemente indizieren, wobei jedes symbolische 
Farbbilddatenelement eines aus einer Vielzahl von Bildpixelfarbdatenelementen definiert, welche ein aus der 
Szenenbeschreibung gerendertes Farbbild bilden, 

Geratefarbpalettedatenelemente, welche fur ein Farbwiedergabegerat eine Farbpalette mit Geratefarben wie- 
dergeben, die durch das Gerat wiedergegeben werden konnen, und 

Bildmetrikdaten, welche eine gewiinschte Beziehung zwischen der Vielzahl von Bildpixelfarbdatenelementen 
des Farbbildes und einer Vielzahl von Zielbildpixelfarbdatenelementen des Zielfarbbildes wiedergeben, 

wobei das Durchfuhren der Berechnungen von Spektralanderungen folgende durch den Prozessor ausge- 
fuhrte Schritte umfaftt: 

(a) Zuweisen von Anderungsvariablen zu den symbolischen Spektralkomponenten in den symbolischen Farb- 
bilddatenelementen, die im Speicher des Gerates gespeichert sind, 

(b) Bestimmen eines neuen Wertes fur wenigstens eine Anderungsvariable, urn modifizierte symbolische 
Spektralkomponenten zu erzeugen, 

(c) Bewerten jeder modifizierten symbolischen Spektralkomponente jedes symbolischen Farbbilddatenele- 
ments mit den indizierten Farbbeschreibungsdatenelementen, urn die Bildpixelfarbdatenelemente des Farb- 
bildes zu erzeugen, 

(d) Erzeugen der Vielzahl von Zielbildpixelfarbdatenelementen des Zielfarbbildes aus den Bildpixelfarbdaten- 
elementen des Farbbildes unter Verwendung der Geratefarbpalettedatenelemente, wobei jedes Zielbildpixel- 
farbdatenelement eine der Geratefarben wiedergibt, die durch das Gerat wiedergegeben werden konnen, 

(e) Bestimmen, ob das Farbbild die durch die Bildmetrikdaten wiedergegebene Beziehung erfullt, 

(f) wenn das Farbbild die Bildmetrikdaten nicht erfullt, Wiederholen der Schritte (b), (c), (d) und (e), bis das 
Farbbild die Bildmetrikdaten erfullt, und 

(g) Anwenden des neuen Wertes jeder Anderungsvariable auf das indizierte Farbbeschreibungsdatenelement, 
das auf die symbolische Spektralkomponente indiziert ist, urn eine Vielzahl von modifizierten indizierten Farb- 
beschreibungsdatenelementen zu erzeugen. 

Verfahren nach Anspruch 6, wobei der Schritt (b) Schritte umfaBt zum (b.1) Bestimmen einer inkrementellen An- 
derungsquantitat aus einem aktuellen Wert der Anderungsvariable und zum (b.2) Anwenden der Anderungsquan- 
titat auf den aktuellen Wert der Anderungsvariable, urn den neuen Wert zu erhalten. 

Gerat fur das Rendering eines Farbbildes aus symbolischen Bildaten mit: 

einer Eingabeschaltung zum Erhalten von symbolischen Farbbilddatenelementen, welche das Zusammen- 
spiel von Licht- und Objektprimitiven im Originalbild wiedergeben, und von indizierten Farbbeschreibungsda- 
tenelementen, wobei jedes indizierte Farbbeschreibungsdatenelement eine Originalfarbe von einem aus einer 
Vielzahl von Objektprimitiven in einer Szenenbeschreibung definiert, wobei jedes symbolische Farbbilddaten- 
element eines aus einer Vielzahl von Bildpixelfarbdatenelementen definiert, welche ein aus der Szenenbe- 
schreibung gerendertes Farbbild bilden, wobei die symbolischen Farbbilddatenelemente symbolische Spek- 
tralkomponenten aufweisen, welche die indizierten Farbbeschreibungsdatenelemente auf die symbolischen 
Farbbilddatenelemente indizieren, 

einem Speicher zum Speichern von Daten, 

einer Ausgabeschaltung zum Verbinden des Gerates mit einem Ausgabemedium und zum Ubertragen von 
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ausgewahlten Daten vom Speicher zum Ausgabemedium, und 

einem Prozessor, der verbunden ist, urn auf die Eingabeschaltung zuzugreifen, urn die symbolischen Farb- 
bilddatenelemente und die indizierten Farbbeschreibungsdatenelemente zu empfangen und um die symboli- 
5 schen Farbbilddatenelemente und die indizierten Farbbeschreibungsdatenelemente im Speicher zu spei- 

chern, wobei der Prozessor weiterhin verbunden ist, um auf die Ausgabeschaltung zuzugreifen, um die aus- 
gewahlten Daten vom Speicher zur Ausgabeschaltung zu ubertragen, 

wobei der Prozessor weiterhin verbunden ist, um auf die im Speicher gespeicherten Daten zuzugreifen, wobei 
10 die im Speicher gespeicherten Daten umfassen: 

Geratefarbpalettedatenelemente, die eine Farbpalette mit den Geratefarben wiedergeben, die durch ein Farb- 
wiedergabegerat wiedergegeben werden konnen, und 

'5 Befehlsdaten, die durch den Prozessor auszufuhrende Befehle angeben, 

wobei der Prozessor beim Ausfuhren der Befehle Berechnungen von Spektralanderungen mit den symboli- 
schen Farbbilddatenelementen, den indizierten Farbbeschreibungsdatenelementen sowie den Geratefarhpa- 
lettedatenelementen durchfuhrt, um modifizierte Farbbeschreibungsdatenelemente zu erzeugen, welche zu- 

20 sammen mit den symbolischen Farbbilddatenelementen die Vielzahl von.Bildpixelfarbdatenelementen des 

Farbbildes erzeugen konnen, wobei jedes Bildpixelfarbdatenelement eine der Geratefarben in der Farbpalette 
des FarbwiedergabegerStes wiedergibt, wobei der Prozessor weiterhin beim Ausfuhren der Befehle die mo- 
difizierten Farbbeschreibungsdatenelemente im Speicher speichert, wobei dadurch ein gerendertes Bild er- 
zeugt wird, das semantisch konsistent mit dem Zusammenspiel von Licht- und Objektprimitiven des Original- 

25 bildes ist. 

9. Gerat nach Anspruch 8, wobei der Prozessor weiterhin beim Ausfuhren der Befehle (1 ) die modifizierten Farbbe- 
schreibungsdatenelemente und die symbolischen Farbbildatenelemente im Speicher auswahlt und die ausgewahl- 
ten Datenelemente vom Speicher zur Ausgabeschaltung ubertragt, wobei die Ausgabeschaltung die modifizierten 

30 Farbbeschreibungsdatenelemente und die symbolischen Farbbilddatenelemente zu dem verbundenen Ausgabe- 

medium ubertragt, oder (2) die symbolischen Farbbilddatenelemente mit den modifizierten Farbbeschreibungs- 
datenelementen bewertet, um die Bildpixelfarbdatenelemente des Farbbildes zu erzeugen, und wobei der Pro- 
zessor weiterhin beim Ausfuhren der Befehle die Vielzahl von Bildpixelfarbdatenelemente zu der Ausgabeschal- 
tung fur die Ubertragung zum Ausgabemedium ubertragt. 

35 

10. Gerat nach Anspruch 8 oder 9, wobei das Ausgabemedium (1) das Farbwiedergabegerat ist, welches die Farb- 
palette mit den Geratefarben aufweist, die durch die im Speicher des Gerates gespeicherten Geratefarbpalette- 
datenelemente wiedergegeben werden, oder (2) eine Datenkommunikationsschaltung ist. 

40 

Revendications 

1 . Precede pour rendre une image couleur a partir de donnees d'image symboliques comprenant les etapes consis- 
tant a : 

45 effectuer des calculs de changement spectral avec des donnees d'image couleur symboliques representant 

I'inter-jeu des primitives de la lumiere et de I'objet dans I'image d'origine ; des donnees de description de couleur 
indexee indexees aux donnees d'image couleur symboliques et des donnees de couleur de gamme de dispositif 
representant une gamme des couleurs de dispositif d'un dispositif de reproduction couleur pour produire des don- 
nees de description de couleur modifiees ; les donnees de description de couleur modifiees, lorsqu'elles sont 

50 utilisees pour evaluer les donnees d'image couleur symboliques, generant une image couleur constitute d'une 

pluralite de couleurs dans la gamme ; chaque couleur dans la gamme etant une couleur parmi les couleurs du 
dispositif dans la gamme du dispositif de reproduction couleur ; produisant de ce fait une image rendue qui est 
semantiquement coherente avec I'inter-jeu des primitives de la lumiere et de I'objet de I'image d'origine. 

55 2. Procede selon la revendication 1 , dans lequel I'operation consistant a effectuer des calculs de changement spectral 
inclut les etapes consistant a : 

(a) determiner des donnees de modification de couleur qui doivent dtre utilisees pour modifier les donnees 
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de description de couleur indexee ; 

(b) evaluer les donnees d'image couleur symboliques avec les donnees de description de couleur indexee et 
les donnees de modification de couleur pour generer une image couleur constitute des couleurs modifiees ; 

(c) generer une image couleur cible a partir de I'image couleur en utilisant les donnees de couleur de gamme 
du dispositif ; chaque couleur parmi une pluralite de couleurs cibles constituant I'image couleur cible etant une 
des couleurs du dispositif dans la gamme du dispositif de reproduction couleur et correspondant a I'une des 
couleurs modifiees de I'image couleur ; 

(d) determiner si I'image couleur satisfait une valeur metrique d'image mesurant une image couleur vahde en 
termes de relation entre I'image couleur et I'image couleur cible ; 

(e) si I'image couleur ne satisfait pas la valeur metrique d'image, repeter les etapes (a), (b), (c) et (d) jusqu'a 
ce que I'image couleur satisfasse la valeur metrique d'image ; et 

(f) modifier les donnees de description de couleur indexee avec les donnees de modification de couleur pour 
produire les donnees de description de couleur modifiees. 

Procede selon la revendication 2, dans lequel la valeur metrique d'image mesure I'image couleur valide en con- 
formite avec une distance dans un espace de couleurs entre une des couleurs modifiees dans I'image couleur et 
la couleur cible correspondante dans I'image couleur cible. 

Procede selon la revendication 1 , dans lequel I'operation consistant a effectuer les calculs de changement spectral 
inclut les etapes consistant a : 

(a) affecter des variables de changement aux elements de donnees d'image couleur symboliques ; 

(b) evaluer les elements de donnees d'image couleur symboliques avec les elements de donnees de descrip- 
tion de couleur indexee pour generer une image couleur courante constitute des couleurs courantes ; 

(c) generer, a partir des couleurs courantes de I'image couleur courante, une image couleur cible utilisant les 
donnees de couleurs de gamme du dispositif ; 

(d) calculer les donnees de difference entre les couleurs courantes et les couleurs cibles ; 

(e) determiner les quantites de changement incrementielles pour les valeurs des variables de changement en 
utilisant les donnees de difference ; 

(f) determiner a partir des donnees de difference et a partir des quantites de changement incrementielles si 
I'image couleur courante satisfait les donnees de valeur metrique d'image ; les donnees de valeur metrique 
d'image incluant les donnees de relation pour mesurer une image couleur valide en termes de relation entre 
I'image couleur courante et I'image couleur cible et les donnees de variable de changement pour mesurer une 
quantite acceptable minimale pour les quantites de changement incrementielles ; 

(g) si I'image couleur courante ne satisfait pas les donnees de valeur metrique d'image, mettre a jour les 
valeurs courantes des variables de changement avec les quantites de changement incrementielles et repeter 
les etapes (b), (c), (d), (e), (f) et (g) ; et ... 

(h) appliquer les valeurs courantes des variables de changement aux donnees de description de couleur 
indexee pour produire les donnees de description de couleur modifiees. 

Procede selon la revendication 4, dans lequel les donnees de relation des donnees de valeur metrique d'image 
mesurent I'image couleur courante en conformite avec une distance dans un espace de couleurs entre une couleur 
parmi les couleurs courantes dans I'image couleur courante et la couleur cible correspondante dans I'image couleur 
cible. 

Procede selon la revendication 1 , tournant sur une machine incluant : 
une memoire pour memoriser des donnees ; et 

un processeur connecte pour acceder aux donnees et memoriser celles-ci dans la memoire ; 
les donnees memorisees dans la memoire incluant 

des elements de donnees de description de couleur indexee ; chaque element de donnees de description de 
couleur indexee definissant une couleur d'origine parmi une primitive d'une pluralite de primitives d'objet dans 
une description de scene ; 

des elements de donnees d'image couleur symboliques comportant des composantes spectrales symboliques 
indexant les elements de donnees de description de couleur indexee sur les elements de donnees d'image 
couleur symboliques ; chaque element de donnees d'image couleur symboliques definissant un element parmi 
une pluralite d'elements de donnees de couleur de pixels d'image constituant une image couleur rendue a 
partir de la description de scene ; 
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des elements de donnees de couleur de gamme du dispositif representant pour un dispositif de reproduction 
couleur une gamme des couleurs du dispositif aptes a la reproduction par ie dispositif; et 
des donnees de valeur metrique d'image representant une relation desiree entre la pluralite des elements de 
donnees de couleur de pixels d'image constituant I'image couleur et une pluralite d'elements de donnees de 
couleur de pixels d'image cible constituant une image couleur cible ; 

dans lequel I'operation consistant a effectuer les calculs spectraux comprend les etapes suivantes executees 
par le processeur : 

(a) affecter des variables de changement aux composantes spectrales symboliques dans les elements de 
donnees d'image couleur symboliques memorises dans la memoire de la machine ; 

(b) determiner une nouvelle valeur pour au moins une variable de changement afin de produire des compo- 
santes spectrales symboliques modifiees ; 

(c) evaluer chaque composante spectrale symbolique modifiee de chaque element de donnees d'image cou- 
leur symboliques avec les elements de donnees de description de couleur indexee pour produire les elements 
de donnees de couleur de pixels d'image constituant I'image couleur ; 

(d) generer la pluralite des elements de donnees de couleur de pixels d'image cible constituant I'image couleur 
cible a partir des elements de donnees de couleur de pixels d'image constituant I'image couleur en utilisant 
les elements de donnees de couleur de gamme du dispositif ; chaque element de donnees de couleur de 
pixels d'image cible representant une des couleurs du dispositif aptes a la reproduction par le dispositif; 

(e) determiner si I'image couleur satisfait la relation representee par les donnees de valeur metrique d'image ; 

(f) si I'image couleur ne satisfait pas les donnees de valeur metrique d'image, repeter les etapes (b), (c), (d) 
et (e) jusqu'a ce que I'image couleur satisfasse les donnees de valeur metrique d'image ; et 

(g) appliquer la nouvelle valeur de chaque variable de changement a I'element de donnees de description de 
couleur indexee indexe sur la composante spectrale symbolique pour generer une pluralite d'elements de 
donnees de description de couleur indexee modifies. 

Procede selon la revendication 6, dans lequel I'etape (b) inclut les etapes consistant a (b.1 ) determiner une quantit6 
de changement incrementielle a partir d'une valeur courante de la variable de changement ; et (b.2) appliquer la 
quantite de changement incrementielle a la valeur courante de la variable de changement pour obtenir la nouvelle 
valeur. 

Machine pour rendre une image couleur a partir de donnees d'image symboliques comprenant : 

des circuits d'entree pour obtenir des elements de donnees d'image couleur symboliques representant I'inter- 
jeu des primitives de lumiere et d'objet dans I'image d'origine et des elements de donnees de description de 
couleur ; chaque element de donnees de description de couleur indexee definissant une couleur d'origine 
d'une primitive parmi une pluralite de primitives d'objet dans une description de scene chaque element de 
donnees d'image couleur symboliques definissant un element parmi une pluralite d'elements de donnees de 
couleur de pixels d'image constituant une image couleur rendue a partir de la description de scene ; les ele- 
ments de donnees d'image couleur symboliques comportant des composantes spectrales symboliques in- 
dexant les elements de donnees de description de couleur indexee sur les elements de donnees d'image 
couleur symboliques ; 

une memoire pour memoriser les donnees ; 

des circuits de sortie pour connecter la machine a un support de sortie et pour transferer les donnees selec- 
tionnees de la memoire au support de sortie ; et 

un processeur connecte pour acceder aux circuits d'entree pour recevoir les elements de donnees d'image 
couleur symboliques et les elements de donnees de description de couleur indexee et pour memoriser les 
elements de donnees d'image couleur symboliques et les elements de donnees de description de couleur 
indexee dans la memoire ; le processeur etant de plus connecte pour acceder aux circuits de sortie pour 
transferer les donnees selectionnees de la memoire aux circuits de sortie ; 

le processeur etant de plus connecte pour acceder aux donnees memorisees dans la memoire ; les donnees 
memorisees dans la memoire incluant : 

des elements de donnees de couleurs de gamme du dispositif representant une gamme des couleurs du 
dispositif aptes a la reproduction par un dispositif de reproduction couleur ; et 
des donnees destruction indiquant des instructions que le processeur execute ; 

le processeur, en executant des instructions, effectue des calculs de changement spectral avec les elements 
de donnees d'image couleur symboliques, les elements de donnees de description de couleur indexee et les 
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Elements de donnees de couleurs de gamme du dispositif, pour produire des elements de donnees de des- 
cription de couleur modifiees capables de produire, associes aux elements de donnees d'image couleur sym- 
boliques, la pluralite des elements de donnees de couleur de pixels d'image constituant I'image couleur; 
chaque element de donnees de couleur de pixels d'image representant une des couleurs du dispositif dans 
5 la gamme du dispositif de reproduction couleur ; le processeur en outre, en executant les instructions, memo- 

rise les elements de donnees de description de couleur modifiees dans la memoire ; une image rendue est 
de ce fait produite qui est semantiquement coherente avec !'inter-jeu des primitives de lumiere et d'objet de 
I'image d'origine. 

10 9 Machine selon la revendication 8, dans laquelle le processeur en outre, en executant les instructions, (1 ) selec- 
tionne les elements de donnees de description de couleur modifiees et les elements de donnees d'image couleur 
symboliques dans la memoire et transfere les elements de donnees selectionnes de la memoire aux circuits de 
sortie ; les circuits de sortie transferant les elements de donnees de description de couleur modifiees et les ele- 
ments' de donnees d'image couleur symboliques au support de sortie connecte ou (2) evalue les elements de 

15 donnees d'image couleur symboliques avec les elements de donnees de description de couleur modifiees pour 

generer les elements de donnees de couleur de pixels d'image constituant I'image couleur ; et dans lequel le 
processeur en outre, en executant les instructions, transfere la pluralite des elements de donnees de couleur de 
pixels d'image aux circuits de sortie pour transfert sur le support de sortie. 

20 1 0 Machine selon la revendication 8 ou 9, dans laquelle le support de sortie est (1 ) le dispositif de reproduction couleur 
presentant la gamme des couleurs du dispositif representees par les elements de donnees de couleur de gamme 
du dispositif memorises dans la memoire de la machine ou (2) un circuit de communications de donnees. 
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